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SUMMARY 


This report presents a brief summary of the develop- 
ment and application of a taxonomy of undergraduate pilot 
training (UPT) tasks and skills. A surface. analysis 
format based on cues, mental actions, and motor actions | 
was developed which described flying tasks in terms of 
the sequential elements within each task. ‘A set of * 
classification rules was developed which utilized thé 
descriptive analytical information generated by the 
surface analysis to identify the skills needed to execute 
the flying tasks described. A coding and matrix system 
was devised,which made the classification system easy to 
use. The resulting taxonomic data system was applied to 


the solution of several representative flying training 
research problems. 


PREFACE 


This report summarizes a portion of the research 
being accomplished in support of Project 1123, Flying 
Training Development under’ the direction of Dr. William 
V. Hagin. The study was documented under Task 112392, 
Instructional Innovations in USAF Flying Training, 

Mr. Gary B. Reid, Tagk Scientist, and work unit 11230217, 
A Behavioral Taxonomy of Undergraduate Pilot Training, 
Dr. Edward E. Eddowes, Contract Monitor. Capt. Jack A. 
Thorpe assisted in editing this summary. of the task and 
skill taxonomy development effort. 


The research reported herein was. conducted under the 
provisions of contract F41609-73-C-0040 by.Design Plus, 
St. Louis, Mo., Mr. Robert P. Meyer, Principal Investigator. 
This effort covered the period between July 1973 and 
September 1974. 
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. : INTRODUCTION 


The Air Force's undergraduate pilot training (UPT) 
program is the keystone of USAF pilot training. This ° 
flying training program has evolved along tyaditional 
lines through many years of trial and errory rather than 
as the result of the application of an analysis and design 
effort. The purpose of this study was to analyze and 
specify the* fundamental flying abilities.which comprise 
the training objectives of UPT. and to develop a broadly 
applicable conception of UPT that can be used to determine 
objectively the requirements for training hardwarg and 
software in research on and development of optimi ed 
flying training programs. 


While a number of analyses of flying tasks have been 
accomplished in the past to identify the pilot's behavioral 
requirements, none of them proved suitable for application 
in the development of a taxonomic structure such as was 
generated by the present research. In this study, the 
results of such task analysis efforts were reviewed and 
revised to produce a surface task analysis format which 
described a pilot's aircraft control behavior. Subse- 
quently, the skill required to accomplish this behavior 
. was identified by applying classification rules and pro- 
cedures which evolved during the study. 


As soon as the pilot's tasks were defined and his 
required skills identified, a taxohomic organization was 
formulated to establish the relationship between flying 
training tasks and skillg. The development of the behav- 
ioral taxonomy of UPT tasks and skills permits future 
research in flying training to focus on fundamental flying 
abilities rather than on training maneuvers and, as a 
result, this research may be expected to be more efficient 
and*economical in producing data to support recommenda- 
tions for improved flying training. 


The present report summarizes the development and 
application of a taxonomy of UPT 4aské and skills. A 
surface task analysi§& based on cues, mental actions, and . 
motor actions was generat which: described flying training 
tasks in terms of their sequential elements. A set of 
classification rules was developed which utilized the 
descriptive analytical information contained in the surface 
analysis. A simplified coding and matrix system was 
devised which made the task/skill classification scheme 
easy to use. The system made possible detailed analysis 
and taxonomic applications which can make an impact on 
future flying training research programs. 


¥ - 


This taxonomic structure provided a tool of sufficient 
depth and flexibility to cover a number of the prime areas 
of research interest for the AFHRL Flying Training Division. 
Using the taxonomy has led to the identification of areas 
of redundancy and commonality within the present UPT pro- 
gram. Further, the taxonomy provides the means for evalu- 
ating the effectiveness of future modifications of the UPT 
syllabus and training methods. In addition, tasks generated 
to fill new training requirements can be supported by data 
generated through the use Of the taxonomy. 


The present report éaphesines the essential features 
of the task and skill taxonomy. The reader may consult j 
the abstracts and summaries of the interim reports identi- 
fied in’the list of:re neces for additional information 
on areas of specific in est. 
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SURFACE TASK ANALYSIS 


A surface task analysis was defined as: An investi- 
gative process that lists behavioral flying tasks in 
sufficient detail, in accordance with established ground 
rules, to be ‘utilized as a tool for classifying those tasks 
into specific flying training categories. The purpose of 
the surface analysis waa to provide flexible, yet discrete 
betavioral descriptions for oo ee flying tasks, 
where task is defined ad: group of related work elements 
performed in close: temporal “Sgcinsty and directed toward 
the accomplishment of a defina work goal. The descrip- 
tions of flying tasks provided by the surface analysis ~ 
permitted identification of the skills needed for tye 
performance of these tasks. To structure the surface 
analysis, a simple model of the flying process was con- 
structed (Figure 1). The human element in the model is 
represented by the assimilation of Cues, and the resulting 
,processes of Mental and Motor Actions, where: Cues (C) - : 
“represent the’ environmental and system stimuli which 
excited the sensory systems of the human body, Mental 
Actions (ME) represent the cognitive processes initiated 
by perceived stimulus cues, preceding motor actions, and 
Motor geeks (MO) represent the physical actions, result- 
ing in movement of aircraft controls. This sequence of 
Cues - Mental Action - Motor Action (C-ME-MO) appeared, to 
be a reasonable format for analyzing tasks and was adopted 
throughout the surface task avery 


The main theme of the analysis — that flying ‘tasks 
can be categorized into three types of transitional tasks: 
fundamental (F), composite (Cp) and corftinuous (Ct). 

Table 1 defines each-of these transitional tasks and 
identifies the specific flying tasks in each of the cat- 
egories. The surface analysis of these tasks was approach- 
ed by applying these three rules: 


1. Each event in a task can be broken down into 
elements consisting of a C-NE-MO sequence. This sequence 
permitted a simple. homogeneous categorizing of tasks. 

The number of eléments has no specific bearing on task 
difficulty, nor is there any particular,correlation with 
a time base intended. However, the format does permit a 
continuity sequencing system. ° 


2. Each task contains a short situation description 
to set the steady-state (dynamic aircraft forces are 
trimmed to allow essentially "hands off" flight) from 
which the transition (a change from one steady-state to 
another) is to begin. A goal‘is noted toward which phe 
transition-or weenie dl tLons progress. 


; tt 


Outside World - Flight Environment "Cues 
VISUAL NON= VISUAL 
1. Sky - Hortzon l. air Turbujence 


2. Weather 2. Gravity 
Earth - Lendmarks _3. Inertia 


’ Performance 
Standards 


Aircraft Generated Cues 
VISUAL AURAL 
1. Flight In:truments Slip Stream Sounds ° 


l. 
2. Inside Refererces 2. Engine Sounds 
3. keconfiguration Sounds 


CONTROL'DYixaALICS 


_. 2« Control System EOTTON 


1. + o0r-G 4. cheek) al tet i 
<. Vibration 5. Decelération ' 
3. Buffeting- 6. Pitch, Roll & Yaw 


Figure 1, Pilot-Aircraft Paradigm 
: 
§ 


3. The aircraft considered was pure jet with retract- 
able landing gear, flaps, and a full complement of flight 
_instruments. : 

. La ? 

Table 2 shows the surface analysis of the first 
C+ME-MO sequence of a 360° overhead landing, a composite 
task. The full analysis contained twenty-three C-ME-MO 
sequences in all. From the descriptions of Cues, Mental 
. Actions, and Motor Actions, a coded card was prepared | 
that later became the major clericalI™“tool for organizing 
and manipulating the full taxonomy. The format and codes 
used.on this card are shown in Table 2, and are explained 
in detail in AFHRL-TR-M-33 (Iv). For‘all tasks analyzed, 
and each sequence in each task, the same type of verbal 
descriptions were written as ‘shown in Table 2, and the 
same type of card was generated to use in the taxonomy 
development. 
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k ‘Table 1, Flying Task Characteristics 


+ 3 
A, Fundamental Transitional Tasks - The twelve control seg- 
ments derived from the four steady-state flight paths, Straight- 
and-Level (St & L), Turn (T)» Climb (C), and Descent (D)}*: ; 


1, St & L—5T ; 7. C——SSt &L 
2. St & L— Sc ; 8. ¢c——T 
3. St & L— >pD + 9. Cc———>D 
4, T————_5St él 1d, D——___—5 st 24 
5. T—— > 11. D———9T 
6. 1T————D "a 12, D——¢ 


The Fundamental Transitional Task is the smallest task part. 


B. Composite Transitional Tasks - Two-or more fundamental trans- 
itional tasks combined to perform a more complex flying require- 
ment. The following are examples of Composite Tasks: 


Take-Offs Lazy-8'9 

Climb-Outs 7. Slow Flight 

Approaches Stalls 

Landings. , F All X-Country Flying 
- Chandelles 


C.* Continuous Transitional Tasks - Any number of fundamental 
and composite tasks-combined in rapid succession to complete 
a complex flight requirement. Continuous Transitional Tasks 
are divided into Primary and Advanced tasks. The following 
are examples: 


Primary - P Advancéd 

1. Loops : 1. Clover Leafs 
2. Barrel Rolls 2. Cuban 8's 

3. Aileron Rolls 3. Immelmans 
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Table 2. Example of Surface Analysis and Coding System 


Aircraft at initial approach speed, level and 
SITUATION & y ¢ 2 


Fisine, Cp-2 tasy 360° oyerheed landing 


TASK GOAL pare Oct., 1975 


level 
Outside ref,approach- 
ing pitch out point 


Aural-Normal envir. sound 
ontrol+Neutrel pressure 
otion-Normal G 


Observes pitch out 
point 


Coordinates aileron 
& rudder, moves 
elevator, adjuste 
throttle 


ah al sovting Slot Number ~————_* 
Skill Within the Task 


360° Overhead Landing Task 

(Use this coded data to find 
ekill group in sorting slot 
content listing) . 


Classified Cues Deta 


Classified Mental Action Data 


Classified Motor Action Data—— 


Pile Card 


TAXONOMY DEVELOPMENT 
i 
The taxonomy established a complete coding and 
notation system for the surface analysis and ite eleménts, 

The taxonomy was defined as: 


A manner of classifying and the rules and principles 
concerned with classification, of the behavioral ie My 
found in the skills described in the surface analysis 
such a way that a useful Pedeysonebip could be established 
among .them. 


Further, a basic skill was defined as the behatioral 
elements that are required to perform each task sequence. 


The taxonomy extracted, by the application of simple 
rules, those behavioral elements which were required for 
the performance of flying tasks. The rules were-.developed 
specifically for this application after careful examina- 
tion of many behavioral classification categories developed 
by previous researchers. 


Taxonomy Format - The initial division in the classi- 
fication aatieietcas followed the surface analysis struc- 
ture and identified the parts of a skill in terms of a 
Cue, ental Action, or Motor Action segment. Each of these 
segments was further subdivided into specific ‘behavioral 
elements and descriptors. Table 3 shows the final form of 
the categories available for each part of a skill deter- 
mined through many iterations. Each rule is also betesty 


discussed by segment.’ ; 
’ ‘ 


Taxonomy Validation - Once the verbal descriptions ‘of 
the C-lb-MO0 sequences of the surface task analysis were 
prepared and the classification rules shown in Table 3 ra 
had been tested and refined, a validation study was per- 
formed to see if these rules could be used effectively by \ 
training research personnel who had not previously been 
involved in the taxonomy development project. The valida- 
tion study determined how well the taxonomy could classify 
the skills derived from:the surface analysis and indicated 
that the taxonomy system was both beets and usable. 


The individual UPT maneuver “aust vote kits consisting 
of instructions, classificatipn rule short sample task 
analysis and two other task analyses “tot classified, 
were presented to USAF subjects. As shown, in Figure 2, a 
three-cqlumn format was a ted in order 
much pertinent informatig o thef evaluat 
and show graphically thé;r®lationship bet 


ras possible 
een the classi- 
fication instructions, the’ surface analysis and the 
behavioral element categories. 


or present as / 
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Table 3. Behavioral Element Categories 
and Classification Rules 


Visual.........¥ 


gc 
S-Cuess +++ 36 
4-u00 so A 


‘. : KENTAL ACTION 


INFORLATION 
PROCESSING 


1-Cue....eeeeL 


T-7 
+--etc. 


DiCISION 
.  COMPLEAITY PROCESSING 
Specific Cue 


lst. Level....L-1 Proceseing....SC 


Simple 
Judgement......SJd 


5 , “emory Recall 
emer Levi hes sede. Procesaing....iP 


: Multi-Cue 
3rd. Level....L-3 Processing... -MC 
Iterative ‘ 
Processing....1IP 
3. MOTOR ACTION 


CONTINUITY CONTROL OUTPUT COMPLEXITY 


Complex 
Judgement......CJ 


4th. Level....L-4 


eT: 
As Texen Ist. Renk......¢R-1 


Elevator...+..+e.5L 
2nd. Hank......-R=-2 
Rudder..........-R — 
Throttle.........TH 3rd. Rark.......R=3 


aa CETE PPPONET | iv. anit: isis a | 
a acces oR= 
Other Outputs....00 |_4t8- Rank R-4 
5th... Rank. ....0 0-5 


Establish 
Attitude.....EA 


Establish Rate 

of Attitude 

Change.......ER 
Speed Brakes -Gear 
Wheel Brakes - Fleps 
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Rules for Cue Classification 


— 


1. Identify all of the different kinds of cues used fin 
the task sequence. 


2. Determine the complexity of the ctes. Complexity is 
determined. by counting the different kinds of cues. 


3. Determine the total- number of cue inpute. This total 
ie determined by totaling the number of individual cues found 
within each of the cues. 


Rules for Mental Action Classification 


1. Determine the complexity of the mental action involved. 
Complexity is determined by noting the number of kinds of cues 
as found in the cues rule No. 2 above (Complexity), counting 
the number of different control and discrete actions in the motor 
action column of the task sequence, and identifying the proper 
category from the following combinations: 7 


Cue 

or more Cues 
or more Cues 
or more Cues 


Zero or one control action 
Non-coordinated control actions 
Coordinated control actions 

Both coordinated and non-coordinated 
control actions 


Select the appropriate information processing category. 
Compare the action verb used by the analyat in the mental action 
column of the tagx sequence with these definitions: 


Observes 
Anticipates 
Determines 
Sustains 


Specific Cue Processing 
Memory Recall Processing 
Multi-Cue Processing 
Iterative Processing 


3. Determine if the mental 
judgment or a complex judgment. 


action entry requires a simple 


A decision based on a specific cue, 
a simple judgment. 


fact, or procedure is 


A decision based on estimation or interpretation is o 
complex judgment. 


Rules for Motor Action Classification 


1. Decide if the motor action results in the establish- 
ment of a stable attitude or produces a rate of attitude change. 


2. Identify all control outputs made by the pilot in this 
task sequence. 


3. Indicate the complexity of the motor actions taken by 
the pilot. Complexity ie determined by selecting the appropriate 
complexity rank from the following list: ee 
One output 
Non-coordinated outputs 
Two coordinated outputs 
Three coordinated outputs 
Coordinated and non-coordinated outputs 


lst Rank 
2nd Rank 
3rd Rank 
4th Rank 
5th Rank 


X —— “=e CLASSI FICATION INSTRUCTIONS 
BEHAVIOR ELEMENT CATEGORIES — 


“— SURFACE TASK ANALYSES 
\ 


\ \ RESPONSE CARDS = 


Figure 2. Maneuver Arfalysis Kit 


es BS . 4 


The maneuver analysis kit was uivane ely. used success- 
fully to: 


1. Evaluate response of subjects in terms of consist- 
ency and determine;,areas of GR EUO ETE LONEANG aut ambiguity 
in the taxonomy components . 


2. Svalnate” the Workability of the proposed coding 
system and response met O64 in actual practice., - 
fee od 
2 3. Produce an or anized taxonomy élangifi¢ation kbt 
which would be used by eng eseerere to classify tasks during 
the project. J 4 


The: classification by the nine subjects who completed the 
study formed the basis for the data analysis. These nine 
test subjects all were knowledgeable in the area of flying 
training. A percentage of agreement was computed among 
subjects for each individual classification rule. Based 
on this agreement criterion, an overall agreement of 82% 
on both tasks was found. Figure 3 shows the agreement 
levels for the individual classification rules. 


1p 
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° y<¢ 
y é 4 
- _% 
cuESs MENTAL “ACTION MOTOR ACTION 
Vecm-- “ule cusied ltbeinam 7? 
Comp- Teta Comp- intermation Decision a Centro Comp- 


c 
‘ +p Ming lexjly Oviputs tenity Processing Processing tinwity Output leaity 


+ 


Taon 2 (Cp-2) 


+ 
\\ ‘ | 
20 Sos + eet Ube { ———— + 


i; | | } | : 
-+ 4 t + 4 + - + - 4 H \ 7 
0 he + + | + = | | | = | te ° Z 


Figure 3. Validation Agreement Level 


The overall high agreement among subject's classifi- 
cations indicated that personnel not specjfically trained 
in the use of the taxonomy could effectively and success- 
fully apply the taxonomy. All subjects entered the study 
naive jand required only a few minutes of instructional 
preparation. A knowledgeable non-pilot showed no scoring 
differences, indicating that only flying term familiarity 
was a prerequisite for taxonomy utilization. 


Taxonomy Summary - The use of the classification 
system was shown not only to be possible, but could be 
executed by personnel only familiar with flying vocabulary. 
There was no requirement for skilled professionals familiar 
with taxonomies to accohplish classification tasks. The 
high overall agreement among subjects in skill classifi- 
cation not only helpéd validate the system, but also showed 
the surface analysis to be a useful research tool. Further, 
similar trends were noted in all tasks (i.e., visual and 
instrument) indicating internal consistency of the classi- 
fication scheme. 
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TAXONOMY SYSTEM OPERATION 


The surface task analysis and ‘classification rules 
then were integrated to provide an effective tool for 
those involved in flying training research, The system 
was developed and organized so that it is usable without 
specialized training. The taxonomy is composed of six 
basic cross referenced data areas shown in Figure 4. 


z 


SURFACE 


SORTING SLOT = asx List TASK ANALYSIS 


CONTENT LIST 


PRIMARY CLASSI FICATION MATRIX 
ILI ap ne 


List gives all Task list xives .Surface analysis 
ekill groups the name and code contains taaks, ' 
in a numbered of all tasks. | task elements & 
matrix slot Card file contains task ekillé. 
all task skills & Skills are cross 
= Classified data by ‘indexed to the 
task & primary mat- card file and the 
rix slot number, primary matrix. 


LEARNING 
SPECIALIST 
* 


Figure.4, Taxonomy Data System 
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1. Classification Hierarchy - This was the basic 4 
organizational structure used in categorizing all tasks 
‘and skills within the taxonomy. It was directly related 
to the nine rules used to classify all tasks in the surface 
analysis. The hierarchy shows at what specific levels 
data from each of the nine rules can be found, 


2. Classification Matrix - The classification matrix 
was the primary device used in sorting all flying skills 
into basic skill groups. Consequently, it also became 
the ‘focal point of the taxonomy as a useful tool. The 
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matrix, composed of eight sub-blocxs, allowed the final 
sorting of skills~into vasic skill groups with the order 
shown in the classification hierarchy. The original 
researcn matrix was a’ four by eight foot board and permitted 
a nands-on method of devVeloping a useful system. 


3. Sorting Slot Content List - This list shows the 
tasks and skills in coded ‘form and: established the basic 
Skill groups PEReL nee in eacn slot in the matrix’ sub- - 
blocks 


- 4. Task Likt - T 
into the task names re 
anzlysis. 


his list translated the task codes 
lated directly to tke surface task 


5. Card File - a scillrcard file was established to 
cross reference all sxill inforination in ‘the taxonomy data 
system. These skill cards were filed according to the 
order sown on the task list. 


6. Surface Task Analysis - The surface analysis 
provided the task informetion upon which the taxonomy was 
built. Each task was made up of task sequences with the 
cues, mental action, and motor action (C-NE-i0) elements 
forming the substance of each: sequence. Since the C-iE-h0 
elements were the building blocks for the basic skills of 
eacn task, reference to this information can be most impor- 
tant to researchers. for this reason, the skill data found 
on each'!file card is also found as a cross reference in 
each C-ME-MO sequence in the surface task analysis. 


PAXONORY Ar“LICATIONS 


The end. product of the taxonomy development ana most 
important area of this research was the illustration of 
its application to flying training. The approach to 
taxonomy applications has been to determine where the 
introduction of such information would be beneficial in 
solving problems relating to flying training. Applications 
can focus on many different ways this taxonomy and the 
taxonomic data system may be used. However, any appli- 
cation may use any of the six areas of the system ta 
assist in problem solution. Two applications to training 
are briefly discussed below to illustrate how the taxonomy 
may be used. Naturally, many other applications are 
possible based on user requirements. In any such appli- 
cation, the taxonomy can prévide a useful structure for 
problem solution. ; 

Redundancy Analysis - fhe first example to be dis- 
cussed compares seitts between two or more flyinz tasks to 
determine gedundancy on a one-to-one basis. Three tasks: 
the loop, Immelmann and Cuban 8 were compared.’ Figure 5 
shows tnese maneuve-s and tneir task sequences, This 
information was then restructurea to list the. basic: skill 
group idertifiers for each task. It was immediately 
evident that approximately tne first half of these tasks 
are identical and that the other half have similar skill 
groupSe 


From this data, a determination of ‘task training 
order can be made. In this case, the number of simple 
versus complex judgments and task lengths were compered. 
This analysis led to the recommendation of the following 
order: loop first, Immelmann second, anc the Cuban 8 
third. This information is important as the cyrrent UPT 
syllabus gives no training order for these tasks. Other 
uses of this data include redefinition of training emphasis 
due to the- repetitive nature of these tasks, the elimi- 
nation of tasks to reduce training time and the development 
of new training tasks jzto replace the old. An example ofa 
new task is presented/ next. 


; 
Standard Flying Task - This example illustrates how 
the taxonomy can supply analysis to assist in the develop- 
ment of standard flying tasks with evaluatior frocedures 
to judge the effectiveness of proposed tasks. } ior the 
example,’ the approach to landing task was utilized. 
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Figure 5. Loop, Immelmann and Cuban 8- Comparison 


Based on a sinple but detailed analysis, a new task 
was developed which ineorporated the essential character- 
istics of the~normal landing task* elements, Further 
inform .tion can be found in the Phase III report AFHRL- 
TR-74-33 (IV) entitled: Behavioral Taxonomy of Under- 
graduate gilot Training Tesks and Skills: Guidelines and 
uxauples for Jaxonouy Application in Flying Training 
Research, The end product was the landing training task 
(St-3) shown in Figure 6. This new task ircorporated 79% 
of the landing skills and added pertinent go-around skills, 
naking it an efiective training task. 


Enter.task St&L at 
cruise, trimmed. 


Transition to low cruise. 
aa 3 sition to descending 


et , turn, lower flaps and 
Reference Pt. no{intain low cruise speed. 


4, Transition to straight ahead 
descent at low cruise using 
outside reference line. 


Transition to climb and 
raise flaps. 


Transition to St&l flight 
trimmed for cruise. 


fransition to turn. 


Reference Pt. 


Figure 6. Landing Training Task ‘ 


_ CONCLUSIONS 


f 


The taxonomy developed dyring this research is a 


~ unique tool which can,be applied to all flying taskd. The 


application of taxonofiic information in training research 
provides specific infaymation on gs well. as increased 
insight in understanding(basic flying skill requirements. 
The taxonomy, thus, can havé a direct influence inthe 
development of present and future flying EBIREDE research 
strategies. 


The taxonomy, which reduced UPT tasks into basic 
skills, can be used to identify skills across a number of 
selected tasks or an entire training syllabus. It is also 
possible to analyze skills within tasks in terms of diffi- 
culty and redundancy. Basic skill groups have also been 
identified. This skill group information has been utilized 
effectively to develop standard training tasks, as well as” 
specific training tasks. The logical structuring of such 
training tasks from objective skill analysis can produce a 
viable building block approach not found in the, current: 
UPT system. , 


This building block concept, through a progression 
from simple to complex tasks and skills, can produce 
improved efficiency and economy in terms of, training time 
and energy utilization. Precise task requirements derived 
from a detailed skill analysis would reduce uncertainty 
for both the student and instructor. A concept such as 
this also lends itself to the increased use of simulation 
‘in flying training in areas other than instryment instruc- 
tion. Training tasks, done to acquire skills needed to 
accomplish a specific task, would provide a logical place- 
ment of simulation within a flying training program. 


A new training strategy based on a skill taxonomy 
which emphasizes the role of simulation is a near term 
reality. The concept, once established, would provide 
_ the kind of flexibility nvaded to accommodate any future 

training requirements. 
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